Explicit solution of relative entropy weighted control

نویسندگان

  • Joris Bierkens
  • Hilbert J. Kappen
چکیده

We consider the minimization over probability measures of the expected value of a random variable, regularized by relative entropy with respect to a given probability distribution. In the general setting we provide a complete characterization of the situations in which a finite optimal value exists and the situations in which a minimizing probability distribution exists. Specializing to the case where the underlying probability distribution is Wiener measure, we characterize finite relative entropy changes of measure in terms of square integrability of the corresponding change of drift. For the optimal change of measure for the relative entropy weighted optimization, an expression involving the Malliavin derivative of the cost random variable is derived. The theory is illustrated by its application to several examples, including the case where the cost variable is the maximum of a standard Brownian motion over a finite time horizon. For this example we obtain an exact optimal drift, as well as an approximation of the optimal drift through a Monte-Carlo algorithm.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

OWA operators with maximal entropy

One important issue in the theory of Ordered Weighted Averaging (OWA) operators is the determination of the associated weights. One of the first approaches, suggested by O’Hagan, determines a special class of OWA operators having maximal Shannon entropy of the OWA weights for a given level of orness; algorithmically it is based on the solution of a constrained optimization problem. In this pape...

متن کامل

Extended MULTIMOORA method based on Shannon entropy weight for materials selection

Selection of appropriate material is a crucial step in engineering design and manufacturing process. Without a systematic technique, many useful engineering materials may be ignored for selection. The category of multiple attribute decision-making (MADM) methods is an effective set of structured techniques. Having uncomplicated assumptions and mathematics, the MULTIMOORA method as an MADM appro...

متن کامل

Robust coding for a class of sources: Applications in control and reliable communication over limited capacity channels

This paper is concerned with the control of a class of dynamical systems over finite capacity communication channels. Necessary conditions for reliable data reconstruction and stability of a class of dynamical systems are derived. The methodology is information theoretic. It introduces the notion of entropy for a class of sources, which is defined as a maximization of the Shannon entropy over a...

متن کامل

Robust Entropy Rate for Uncertain Sources and its Applications in Controlling Systems Subject to Capacity Constraints

The robust entropy rate is defined as the maximum of the Shannon entropy rate, when the joint probability density function of the source is unknown. The uncertainty of the source probability density is described via a relative entropy constraint set between the uncertain source probability density and the nominal source probability density. For this class of problems, the explicit solution for ...

متن کامل

Explicit multiple singular periodic solutions and singular soliton solutions to KdV equation

 Based on some stationary periodic solutions and stationary soliton solutions, one studies the general solution for the relative lax system, and a number of exact solutions to the Korteweg-de Vries (KdV) equation are first constructed by the known Darboux transformation, these solutions include double and triple singular periodic solutions as well as singular soliton solutions whose amplitude d...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Systems & Control Letters

دوره 72  شماره 

صفحات  -

تاریخ انتشار 2014